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ABSTRACT 



Knowing how well maintenance technicians perform mainte- 
nance on the job is necessary in order to evaluate the effec- 
tiveness of training. This paper reviews data on one possible 
measure; specifically, the unnecessary removal of non-faulty 
parts during actions taken to identify and correct malfunc- 
tions in equipment. Such data may be found in the maintenance . 
management data 'systems of the military services. 

It was Bound that non-faulty components are removed in 4 
to 43 percent oi etll corrective maintenance actions and account 
for 9 to 32^ percent of all maintenance man-hours. Technicians 
fail to find a faulty part or damage a good part, in about 10 
percent of all corrective maintenance actions. 

These findings may be due to inadequate .test equipment, 
tools, and maintenance manuals, as well as to inadequate train- 
ing. 

There is a need to collect data on the performance of main- 
tenance" technicians- on the job in a way that can be related sys- 
tematically to procedures used in military selection and train- 
ing. . 
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' v SUMMARY' 

A. PURPOSE ^ 

The purpose of this paper.- is to review data that describe 
the job performance of military maintenance technicians. 

BV BACKGROUND- 

The effectiveness of, military maintenance training is 
•almost always evaluated o?*> the basis of hoy well students per- 
format school, i.e/, test scores at thev completion of a course • 
An important question, however, rs how well training at school 
prepares maintenance technicians to perform maintenance on the 
job. Little objective data are available on the job performance 
of maintenance technicians. Without such data, it is difficult 
to assess the effectiveness of maintenance training, an impor- 
tant .isstue in cost-effectiveness evaluations of military train- 
ing. r~ 

Each military service operates a jnaintenance management 
data system that y contains information on the conduct of all 
maintenance action^ (or tasks), e.g., what equipment was main- 
tained, why maintenance was required, what was .done and who did 
it.. Although these systems were ; not designed to answer questions 
about training, the present effort was an attempt to see whether 
they might be used,^in spme way, for such purposes. The scope 
of the effort, was limited to data*or\ the unnecessary removal 
of good parts during actions taken <to identify and correct mal- 
functions in equipment. 



C-. FINDINGS * 

According to seven studies, non-faulty parffs were removed 
in 4 to 43 percent of all corrective maintenance actions, and 
account .for 9 to 32 percent of all maintenance man-hours. One 
study reports that technicians failed to find a faulty part or 
damaged a good part in 10 percent of all maintenance actions. 

Only limited efforts were made in these studies to examine - 
why 'these amounts of ineffective maintenance were observed. 
Suggestions are offered that the reasons include inadequate 
test equipment, tools, 'and documentation, as well as inadequate 
training. 

D. CONCLUSIONS 

•Available data, though limited in scope primarily to the 
unnecessary removal of non-faulty parts, offer strong evidence 
that maintenance technicians may conduct maintenance in an 
inappropriate and inefficient* manner . 

E. RECOMMENDATIONS' . " 

{ 

It is recommended that additional data be~collected on the . 
performance of maintenance technicians on the job to estimate 
not only the unnecessary removal of non-faulty parts but also 
the failure to remove "faulty parts and damage caused to good 
parts while performing maintenance. Data are also needed to 
identify the factors that may lead to inappropriate maintenance, 
such as inappropriate test equipment, tools, docixnentation, and 

training among a numbfer of possible factors. 

\ ^ 
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A) 



I . INTRODUCTION 



It 'is obvious that the performance of maintenance techni- 
cians is' one of the factors Chat can influence thd operational 
readiness of weapon systems in the field. ' Nevertheless, sur- 
prisingly little objective data are available to document how 
well technicians do what, they are supposed to do. Thj.s paper 
summarizes 'the objective data that we were able t'o compile 
concerning the job performance of maintenance technicians.* 
Objective job performance data are needed to evaluate the 
effectiveness of procedures usecT*by- the military services to 

^ select and train maintenance technicians. At present, methods 
of ^selection and training are validated a^lmgst entirely. on the' 
basis of how maintenance technicians perform at school rather 
than on the job.. Supervisors 1 ratings are sometimes used to 
evaltiatfe training courses. This method of validation . involves 

, subjective judgments that may be influenced by impressions 
about motivation and cooperation' that have little to do with 
capability to perform well on the job. 



*This study was performed for the Office of the Deputy Under 
Secretary of Defense for Research atfd Engineering (Research 
and Advanced technology), under the technical cognizance of, 
the Military Assistant for Training and Personnel Technology, 
It is one of a series concerned with Cost and Effectiveness 
Methods for Defense Training (DARPA TO T-134). 
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II. MAINTENANCE MANAGEMENT DATA SYSTEMS 

,The military services operate large data management systems 
to provide detailed information on the current maintenance status 
-of military equipment. These data systems are identified in 
.Table 1. The general purpose of these systems is to provide 
information needed to manage the maintenance of weapons and sup- 
port equipment , the availability of spare parts, the types of 
malfunctions that are being encountered, and so on* These sys- 
terns were designed to provide information needed for purposes 
of maintenance and logistics ar\d not about the performance of 
.military technicians. 

- TfcBLfi 1. MAINTENANCE. MANAGEMENT DATA SYSTEMS USED 
* BY THE MILITARY SERVICES 



Service ■ 



Maintenance Management System 



Name 



Short Title 
r * 



Army 
Navy 



The Army Maintenance Management System* TAMMS 

Naval Ships 1 Maintenance and Material Ships 1 3-M 
Management System 



Navy 



Na^val Aviation Maintenance and 
Material Management System 



. Aviation 3-M 



Air Force Air Force Maintenance Management Systems 66-1 and 6 6-5 



The possibility of using data available in these systems 
to describe the performance of maintenance' technicians in the 
.field has been examined (see String and Orlansky,, 1981). As 
presently constituted, these systems cannot provide" information 
useful for assessing the on-the-job effectiveness ' of alternative 
methods of -selection and training. The ability to identify and 
track individuals is a mandatory requirement of any ^tterapt to 
relate criteria for selection or methqgf of training to perform- 
ance oh the job. The names of^- individuals who perform' mainte- 
y^nce actions are not kept in the permanent records maintained 
in the central data files of each service. Maintenance records, 
which include names of personnel who did the work, are kept 
only at the field activities, but they^are discarded after 6 
months. The use of maintenance records with personal identifi- 
cation for analytical purposes would require special methods of 
processing in order not to infringe on precisions of the Privacy 
Act. Even so, such records are ftdt; precise enough' to distinguish 
what parts of a 'maintenance action were performed by a particular 
individual, especially when the work is performed over more than 
one shift. The practice of cross-skill maintenance, that; is, 
to train individuals to maintain a wide variety of equipment 
und6r combat conditions, assigns individuals to tasks for which 
they, were not trained at school; this practice would complicate 
any analytical effort to relate training at school to E&pformance 
'on the job. In brief, it was concluded that presently available 
maintenance data records cannot be used to assess the effective- 
ness on the joB^of various methods of training at school. It 
is conceivab^ ih^t these systems could be modified to proyide 
the data that would be needed, but that is not the subject of 
this paper. 
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III. DATA ON INCORRECT MAINTENANCE ATTRIBUTED TO PERSONNEL 

Certain information collected by the maintenance management 
data/sy^tenfs may be used to make inferences about the quality 
of performance of maintenance technicians in the ^actual environ- 
ment of day-to-day work. Specific examples concern data on 
components removed erroneously, i.e., components removed for" 
replacement or repair that .were found later not to contain any 
'malfunction; another would be a report of no malfunction when 
one was found immediately afterwards. Such data may be used to 
characterize the work of a group of technicians In a particular 
work cente^; -it does- not identify particular individuals and 
therefore cannot be related to. their individual characteristics 
'with respect to test performance ^when selected or method of 4 
training prior to their current assignment. Some^qualif icat iqns' 
about the use of data on the removal of non-faulty parts will 
be discussed later. 

A. "NAVY F-14A AIRCRAFT f 

According to Gold, Kleine, -Fuchs, Ravo, and Ioaba (1980) 
maintenance technicians can produce 'three kinds of "errprs in . 
organizational maintenance: -replace a good unit, fail to replace 
a bad unit, or damage the system in some way (see 'Table 2). 
Some of these errors can produce significant effects, e.g., 
abort an operation, require repetition of the troubleshooting 
and repaif activity, waste spare parts, place an additional 
load on the maintenance* activity, or perhaps lead to an injury 
or accident. ^ 
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Type Qfi 
Error 



TABLE 2. KINDS OF MAINTENANCE ERRORS 
Explanation »of ' grror 



Removal of functioning equipment: 
technician replaces. a unit that 
has not malfunctioned. 



Typical " 
Source o^ Error 



Troubleshooting 



II 



/a 



Failure to remove faulty equip- 'Troubleshooting; 
ment: technician fails to recog- $ "checkout 
nize a unit .that has malfunctioned \ 
or has been improperly handled. 



L 



Damage to equipment: , t^chnffcian 
fails to accomplish a corrective 
or preventive action properly. 



Removal/ instal- 
lation; service ; 
repair; adjust/ 
align . 



Source: Gold, Kleine, Fuchs,*Ravo, a-nd Inaba (1980), p. 12 v 

Gold, Kleine, Fuchs , Rata, and Inaba (1980) used data from 
the Naval Aviation Maintenance and Material Management System 
(Aviation 3-M) to describe the readiness status of six F-14A 
squadrons (72 aircraf^ bver a period of 1 year (Table 3). At 
any given time, (42 percent) "of the 12 aircraft iri each ' ■ 

squadron were not ready for operational assignments, for >main- 
tenance conditions given in the table; two (17 percent) of the 
aircraft were not ready because of unscheduled maintenance. 
Ea^h F-14A aircraft inquired an average of 43 man-hours of or- 
ganizational lWel maintenance for each hour' of flight (Table 4) 
over 16 (38 percent) of these man-hours were devoted to correc- 
tive maintenance. 

An analysis w^s made of the frequency of each type of cor- 
redtive maintenance (CM) error according to responsible* -work 
cente^l Table 5. Nearly 14 percent of remove and replace opera- 
tions^(4 percent of all' CM actions) involved removals of func- 
tioriin^ equipment (a Type I error); nearly -10 percent of all 'CM 
actions failed, to remove faulty equipment (a Type II ertor) or 
resulted in damage to equipment (a Type d error). Nearly 14 per 
cent of all CM actions resulted in one of these 7 error conditions 
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. TABLE 3. READINESS CONDITION OF AN AVERAGE SQUADRON 
OF F-*14A AIRCRAFT OVER ONE YEAR 

(12 aircraft, per squadron) ^ 



Operational 
Status of 
'Aircraft 




i 

Maintenance 
Condition 


Average Number 
of aircraft 








Number 


Percent 


Ready *~*Full, systems capable 


6,20 


51% 




Reduced material condition 
due to unscheduled maintenance 


• 38 


3 


» r « 


•Not 


fully equipped 


.39 


3 






Total 


6-97 


58% 


Not ready 


Due 


to scheduled maintenance 


• 48 


4% 




Due 


to unscheduled maintenance 


2.00 


' 17 




Due 


to supply 


2. 61* 


22 






v Total 


> 5-09 


"42% 






TOTAL 


12.06 


100% 



SOURCE: - Gold, Kleine, Fuchs, Ravo, and Inaba ( 1980) 'p. 70 

TABLE 4. ORGANIZATIONAL MAINTENANCE MAN-HOURS PER FLIGHT 
HOUR IN SIX SQUADRONS OF F-14A AIRCRAFT 



Maintenance - Category _ Man-hours Per Flight Hour 







Number 




Percent 


Planned maintenance (PM) 


( 


19.2 ' 




44% 










Corrective maintenance '-{CM) 




16.4 




38 


Support actions (SAF) 








15 


Technical directive compliance 


(TDC ), 


1.2 




3 


1 TOTAL 




• 43.2 




100% 


SdURCE: Gold, Kleine, Fuchs, 


Ravo, and 


Iriaba (19 80), 


p. 71 
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TABLE 5. SUMMARY OF 


CORRECTIVE 


MAINTENANCE 


ERRORS FOR F-14A AIRCRAFT 


• Work Center 


Type I a ' d 


Type I a ' 


e 


Type II/d b ' e 


All 
Errors 6 


Organizational Main- 
cenance uepar uiienc 


1 A ca 

14. S% 






9.8% 


13.8% 


rv-tuor Dl anf c f 1 1f\\ 


b . / 






15.9 


17.2 


t\±L 1-LOllKZ \±£\j) • 


"7 O 


±•4 




16.0 


17.4 


uorrosion uoncroi [izi) 
• 


0 


0 




' 6.4 


6.4 


Aviator .Equipment- (131) 


- 0 


0 




4.1 


4.1 


Safety Equipment (132) 


' ' 20.2 


4.4 




11.0 


15.4 


Electronics (210) 


14.8 


4.1 




8.5 


12.6 


cj.ecurica± xnscruinenus 
(220) 


20.1 


4.3 




'6.7 


11.0 


Armaments (230) 


6.1 


1.2 




6.6 


7.8 


Electro-Weapons Control 
- (232) c 


18.0 


8.4 




7.3, 


9 

15.7 


Q 

Trouble shoo t eips (320) 


0 ' 


0 




12.5 


12.5 



a Removal of non-afaulty parts 

•^Failure to recognize a malfunction/damage induced by technician 
c Includes AN/AW3-9 Radar that accounted for over 60 percent of CM 

actions anfc errors 
^Expressed as percent of RR jobs 
e Ex pressed As percent of all CM jobs 

All CM actions are the sum of: TS + RIP + RR + CANN 

where: T$ = Tbtal Troubleshoot Jobs 

^ RIP = Tbtal Repair-In-Place Jobs 

RR = Tbtal Remove-aad-Replace Jobs 

CANN = Tbtal Cannibal ization Jobs 

All Errors are the sum of: EI + EI ID 
> \ where: EI = Tbtal Errors of Type I » 
^ EIID = Tbtal Errors of Type II or d 

SOURCE: Gold, Kleine, Fuchs, Ravo, and Inaba (1980), p. 74 

Private conversations with David G3$d and Sal Ravo, XYZYX Informa- 
tion Corporation. 

4 
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4 The Aviation 3-M' system does not report directly that tech- 
nicians have produced various types of errors; this is inferred 
by Gold, Kleine, Fuchs, Ravo, and Inaba (1980) in the Tables 
shown above. In the Aviation. 3-M system, the Aircraft Interme- 
diate Maintenance Department Report^cites cases where "no de- 
*febts H were found in components removed from aircraft. Gold, 
Kleine, Fuchs, Ravo, and Inaba (1980) call these "unjustified 
removals' 1 (Type.l error)! This interpretation does not seem 
appropriate* in all cases. Consider the following situations: 
(I) a technician removed a component because the test equipment 
available to him was not -capable of isolating a malfunction to 
a single system element (i.e., it could localize the fault to a 
group of black boxes of which only one was found later to be 
faulty); (2) two elements of a system, one highly interactive 
so the one element will" function correctly with one article 
(black box) of the second element but not v/ith a second black 
box of the same model. When under pressure to meet a required 
flight time, a technician may knowingly replace a number of 
*black boxes, without testing, to be certain tfcat the faulty 
orte is replaced prior to flight time. 

Gold, Kleine, Fuchs, Ravo, and Inaba (1980) also inferred 
failures to remove faulty equipment or faulty repair* (type II 
and Type d errors) in cases where their analyses related observed 
malfunctions to previous reports of failure to find any malfunc- 
tion in the same components. Some of these cases may have in- 
volved temporary "quick-fixes," e.g., tightening a connector or 
, fastener known to be degraded. As noted elsewhere in this paper, 
the Aviation 3-M maintenance data system was designed to provide 
information on the status of equipment and not on the quality of 
•humap performance as a possible source of certain malf unctions"^r 
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B- ARMY RECONNAISSANCE VEHICLE TURRETS 

A recent study of ?organizat iprial level support in an Army 
brigade-sized unit produced similar results. In the Army, parts 
found to be faulty during organizational maintenance are submit- 
ted for exchange to a shop which performs direct support main- 
tenance. A Maintenance Request Fo^m (DA 2407) is filled out for 
each exchange. Dressel and Shields (1979) determined whether 
the parts submitted for repair over a period of 1 year were 
found later to be faulty? attention was limited to the turret 
of the Armored Reconnaisance Airborne AssauLt Vehicle (M 551). 
On behalf of the study, the maintenance shop manager completed 
a' special form (ARI SF 77-1) which recorded the specific repairs 
required' and other information of interest for each part that 
was exchanged. The main .'findings are summarized in Table 6. 
Almost half (42 percent) of the items submitted for repair were 
hot faulty; 32 percent of all man-hours spent in thf repair 
Shop were applied to items found not* to contain a fault. 

TABLE 6. ANALYSIS OF ITEMS REMOVED FOR MAINTENANCE PURPOSES 
FROM TURRETS OF THE ARMORED RECONNAISSANCE AIRBORNE ASSAULT 



VEHICLE IN 
(Data from 


AN ARMY BRIGADE FOR 
Dressel and Shields, 


1 YEAR 
1979 ). 


> 


• — 

Data 'On Removals 


— r— r 

Total 


Non-Faulty 


Items 






Number 


Percent 


Requests for repair 


584 


246 


42% 


Repair time 


1146 hrs 


367 hrs 


32 


Average time in shop 


5.6 days 


4.0 days 


71 


Average repair time a 


2.3 hrs 


1.5 hrs 


' 65 


Cost of items submitted 
for repair 


$1.24 M 


$0.36 M 


29 



a Confirmed malfunctions only. 
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C. NAVY EA-6B, E-2C, SH-3H, AND S-3A AIRCRAFT 

Jewell and Webman (1979) analyzed maintenance records on 
all Navy EA-6B, E-2C f *SH-3H f and S-3A aircraft for 1977 as 
reported in the Naval Aviation Maintenance and Material Manage- 
ment System (Aviation 3-M) . This data base accounted for a 
total of about 1.8 million man-hours of maintenance work and 
about 385/000 maintenance actions. Attention was given primar- 
ily to "no-defect maintenance" defined as unscheduled mainte- 
nance on components for which no corrective action was required 
(See Table 7). About 15 percent of all actions both in organi- 
zational and intermediate maintenance were or\ items found not 
to have any defects; about 17 percent of the man-hours in orga- 
nizational maintenance and about 9 percent of the man-hours in 
^intermediate maintenance were expended on items found not to ' 
haV*e any defects. • On the basis of interviews with maintenance 
personnel^ Jewell and Webman (1979) conclude that maintenance 
is performed on items found not to have defects because., of 
inadequate built-in test equipment that cannot isolate equipment 



TABLE 7. AMOUNT OF MAINTENANCE ACTIVITIES ON NAVAL AIRCRAFT 
I WHERE NO DEFECT WAS FOUND/ 1977 

[Source: - Jewell snd Webman (1979)] 



Leval of 
Maintenance 



Maihtenance Activities , 1977 a 



Man-Hours 



To£al Percentage due 
(000) to Removal of 

No-Defect Items 



Maintenance Actions 

Total Percentage due 
(000) to Removal of 

No-Defect Items 



Organizational 1119 



Intermediate 



650 



17.0% 
9.3 



322 
63 



14.8% 
16.1 



ERLC 



a Data for maintenance on all Navy EA-6B, E-2C f SH-3H/ and S-3A 
aircraft during 1977 as shown in Naval Aviation Maintenance and 
Material Management System. / ' 
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test equipment that cannot isolate equipment failure , because 
systeiji complexity precludes simple fault isolation, and because 
systems inte gr a t ion requires personnel to be knowledgeable an 
several ' systems Vithou^ adequate training on all of them. These 
explanations are based on the interviews; although they appear 
reasonable, no data are offered to support these conclusions. 

D. ARMY ELECTRICAL AND VEHICULAR COMPONENTS • 

\ 

"In a test conducted at Fort Carson, Colorado, an average 
of 35 percent of the generators, regulators, alternators, dis 
tributors, and starters returned as unusable were actually 
serviceable" ♦* According to the Brown Board Survey 19 66, 4 s ? 
percent of the vehicular components removed as faulty in* field 
maintenance were found slater to be good. f 

E. AIR FORCE A-7D, F-111A, AND F-4D AIRCRAFT 

• Johnson and Reel (1973) report that 9 to 13 percent of 
the components removed for failure on three types of aircraft 
(A-7D, F-111A, and F-4D) were found later in the shop to be 
serviceable; note that these data refer to percent of components 
removed that were found to be good rather than percent of. 
maintenance actidns ifi which good pajrts were removed. Johnson 
and Reel also report that 8 5 percent of the good parts removed 
came from avionics systems; the remainder came from airframe 
and utility systems r propulsion, instruments, and autopilots* 



♦Tiws statement appears in Buchan and Knutson, 1977. The study, 
Troubleshooting Test Conducted by the USAMMCS at Fort Carson, 
CO, ,1-31 July 1974 , was not seen. A relevant table from that 
study and information about the Brown Board Survey were pro- 
vided by J. Shields of the Army Research Institute. 
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F. ARMY UH-1H, CH-47C, AND C^57B HELICOPTERS 



The maintenance of Army helicopters was analyzed because 
"over 50% of Army aircraft maintenance diagnoses at organiza- 
tional level were reported as being incorrect by>a high-ranking 
'military official. U.S. Army Agency for Aviation Safety (USAAAVS) 
reported that poor inspections and/or improperly performed main- 
tertance actions were frequently thefba^use .oE helicopter mishaps" 
(Holbert ancT^ewport , 1975, p. 24)/ 

An analysis of over 5000 maintenance records of the UH-1H 
and CH-47C helicopters (6 months each) and of maintenance rec- 
ords. of 8500 flight hours for theCH-54B helicopter (30 months) 
showed that there were 0.23, 0.32, and 0.07 repetitive mainte- 
nance actions (respectively) per flight hour; these maintenance 
actions apply to the same malfunctions oh the same aircraft 
reported frequently over short time periods. Total maintenance 
actions, including those for non-repetitive malfunctions', were 
not reported. The repetitive actions identify frequently recur- 
ring malfunctions, e.g.<, altitude indicator, high engine oil 
temperature, fuel-low light, engine exhaust duct.* About half 
of thQr repetitive maintenance actions are attributed to inade- 
quate/test equipment, troubleshooting, and standard maintenance 9 
practices; about 20 percent are attributed . to inadequate train- 
ing, tools, and maintenance, manuals . 

Holbert and" Newport tried to determine the frequency of 
incorrect diagnoses of malfunctions by comparing records .sub- 
mitted by ttie organizational-level maintenance activity -with 
those for the same components ^t depot-level overhaul and 
inspection. Records of maintenance of t^ie UH-1H and CH-47C g& 
helicopters at three operational bases and frwo-depots for a 
6-month period were examined. It Was fbund that depots are 
not required to use the organizational-level form (DA Form 2410) 
with diagnostic information if they use assembly-line produc- 
tion methods for overhaul. Thetfefotje, an objective comparison 
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of diagnoses of malfunctions could not be made. On the basis 
of interviews with personnel at the depots, it was estimated 
that \5 to 25 percent of transmissions going through overhaul 
are founds to have no defects or malfunctions, 

G. ARMY HELICOPTERS 

Reilly (1977) reviewed reports of 13,037 mishaps to six 
classes of Army helicopters from 1969 to 1976. The overall 
proportion^of mishaps attributed to maintenance error was 5.7 
percent. Most errors wer^ attributed to factors, other than 
errors in maintenance, such as materiel malfunction (52 percent) 
and crew error (29 percent); the total cost of all mishaps iij 
this sample was $270 million. Since this study does not report 
infofcmation on the removal of non-faulty parts, it is not 
included in the discussion that follows. 
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IV. DISCUSSION 

» 

A summary of these studies of the removal of non-faulty 
parts during corrective maintenance, appear^ in Table 8, The 
removal of non-faulty parts occurs in 4 to 43 percent of all 
corrective maintenance actions in these data; the median value 
s of 11 data sets is 15 percent. The removal* of non-faulty parts 
v accounts for 9 to 3 2 percent of all maintenance man-hours (for 
three cases where such data were reported)* 'According to one 
study, technicians fail to find a faulty part. o,r damage a good 
p,art in about 10 percent of all corrective maintenance actions 
.(Gold, Kleine, Fuchs, Ravo,.and Ijpaba, 1980), 

These data suggest that inadequate performance by techni- 
cians is a factor that contributes to the. 11 not-ready ,f status of 
military equipment. Other factors would include the unavaila- 
bility of spare parts, test equipment, and up-to-date technical 
documentation. For example, Go^d, Kleine, Fuchs, Ravo, and 
Inaba (-1980) estimate that over a* 1-year period, an^average of 
22 percent of the F-14A "aircraft were not ready for reasons 
due to supply. According to a questionnaire, about 50 percent 
of 551 Army technicians believed that repetitive maintenance- 
(same malfunction) of Army helicopters was due primarily to 
inadequate test equipment^ troubleshooting, and standard main- 
tenance practices; about 20 percent gave inadequate training, 
tools, and maintenance manuals a's a secondary cause (Holbert 
and Newport, 1975). ^ These findings appear to identify a signif 
icant problem in military maintenance but do not suggest a 
meanS to its solution. * " 

* 1 ' 14 

23 



< 



TABLE 8. 



SUMMARY OF STUDIES OF ORGANIZATIONAL ECHELON CORRECTIVE 
MAINTENANCE WHERE NON-FAULTY PARTS WERE REMOVED * 











* * Corrective Maintenance Where Non-Faulty 
Parts Were Removed 


* 


1 Equipment or 
I System 


Size of 
Samp 1 e 


Period of 
Observation 


Data Source 


Maintenance 
Echelon 


Percent of 
Actions 


Percent of 
Man-Hours 


References 


I F-14A Aircraft 

1 'Armored recon- 
1 n&issance and * 
1 airborne assault 
1 vehicle (H 551) 


72 

Alrcra ft 
brigade 


1 yr 
1 yr 


3H and analyses 

Maintenance* , 
Request Form 
(DA 2407) and 
special form 
for study v 


Organizational 
Organizational 


AX 

9 

42 


11% 


uoia, Meine, fuchs, 
et al. , 1900, and 
private conversa- x 
tions with the 
authors 

Dressel and 
Shields, 19/9 


Aircraft: EA-6B, 
SH-3H, S-3A 

* 


All Navy 
1.8M man- 

0.4M actions 


1 yr 

0 


' 3H and inter- 
views 


Organizational 
Intermediate 


15 
16 


17 
. 9 


Jewell and 
. Webman, 1979 \ 


Electrical com- 
ponents: genera- 
tors, regulators, 
alternators, d Is- 

it i uu iuri , 

starters 


Fort Carson 
CO 


1 mo 


■ 


Organizational 


35 




Buchan and 
Knutson, 1977 


Vehicular 
components 

Aircrafti 
A- 70 
F-I11A 
F-40 


' j 

» 

* 


• 


■I 


flr*n A n i 7 A t i nn * 1 
i/i ijaii i ca \. | una 1 

Organizational 
Organizational 
Organizational . 


12. 9* 
9. Of 
8.8 a 




Brown Board 

Survey, 1966 v 

Johnson and 
Mee 1 , 1973 


Hel IcVpters 
















UH-^H 
CH-47C 

i 


82 b 
123 d 


6 if) 

• 

6 mo 


(Component re- 1 
/moved a*nd repalr/f 
joverhaul ( 
(Record (DA 2410) ) 


Organizational ' 
Organizational 


15 to 25 c 
15 to 25° 




liolbert and 
Newport, 1975 







d. As above-* U.other records (10 percent) had no failure code., : 

" $ : 
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The .data satople is small and may not be representative. 
The removal of non-faulty parts may not always be an inappro- 
priate action, e.g., the test equipment may malfunction or not 
be capable of distinguishing between a faulty *and non-faulty 
part? if the technician is under pressure to have equipment 
ready for a mission, he may remove and replace a large number . 
of cdmponents without sufficient tests in order to make sure 
that all possible malfunctions have been removed. Finally,, 
the data .apply to all maintenance actions within a large unit 
and not to the performance of particular individuals. 

Qn'e particular value of data describing the quality of 
performance of maintenance ^personnel on jobs in operational 
settings would b* their use in validating selection standards 
for recruiting and assigning to career paths and evaluating 
the effectiveness, of various methods of training (e.g.., conven- 
tional instruct ipn compared to computer-based instruction, use 
of maintenance 'training simulators as opposed to actual equip- 
ment training). As a general matter, the effectiveness of 
military selection and training, has been evaluated on the basis 
of performance of technicians at school and not on the job. 

- The latter is the more relevant criterion. 

> 

k It is conceivable that the^data gengr^ted through mainte- 
nance management systems of the military services could be 
modified to prbvide information on the performance of mainte- 
nance technicians. These systems were designed primarily to 
manage maintenance services and cannot be faulted for not pro- 
viding information about personnel relevant to selection and 
. training. A prototype system for providing some of this infor- 

X 

mation has been developed and is now being tested by the U.S. 
Army Research Institute (Katz and Drillings f 1981 ) . Call'ed 
the Army Maintenance Per:^^mance System, it records the wortf 
experience (time on e"ach technical task irr the maintenance 
battalion) and training * ( cour*es and qualification tests) of 
each maintenance technician. This record system is not planned 
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tQ be part of The Army Maintenance Management System; it would 
be used by work supervisors and training managers; each soldier 
would carry his own record -of experience and skill history • It 
does not appear that tflis record system x would contain informa- 
tion about^ effective and ineffective performance, e,g w time to 
diagnose malfunctions , success and failure to diagnose malfunc- 
tions of various types • • 
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V. FINDINGS 
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Listed below are the major findings, resulting from this 
study. 
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IV Non- faulty components are removed i?r^4-lfcc( 4 3 percent 
of all corrective maintenance actions and account for 
9 to 3 2 percent of all maintenance man-hours. 
"Technicians fail to find a faulty part or damage a 
good part in about 10 percent of all corrective main- 
tenance actions. 1 

Maintenance technicians believe that repetitive^ main- 
tenance for the samQ malfunction is due primarily to 
inadequate test equipment, troubleshooting, and stand- 
ard maintenance practices, and secondarily to inade- 
, quate training, tools >• and maintenance manuals. 

4. These findings are based on seven studies ceported 
from 1975 to 1980. Diagnostic studies are rtefeded to 
clarify the extent to which human performance affects 
the quality of maintenance in 'different types of weapon 
and support systems and to identify ways of improving 
the personnel aspects of maintenance. 

5. _>bata on. the performance of maintenance technicians on 

the job should be collected in a way tttat can be re- 

* 

lated to procedures used in military selection and 
training. 
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